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Why GAO Did This Study 

About a third of students entering 
high school do not graduate and 
face limited job prospects. The No 
Child Left Behind Act requires 
states to use graduation rates to 
measure how well students are 
educated. To assess the accuracy 
of states’ rates and to review 
programs that may increase rates, 
GAO was asked to examine (1) the 
graduation rate definitions states 
use and how the Department of 
Education (Education) helped 
states meet legal requirements, (2) 
the factors that affect the accuracy 
of states’ rates and Education’s role 
in ensuring accurate data, and (3) 
interventions with the potential to 
increase graduation rates and how 
Education enhanced and 
disseminated knowledge of 
intervention research. 



What GAO Recommends 



GAO recommends Education 
provide information to all states on 
ways to account for different types 
of students in graduation rate 
calculations, assess the reliability 
of state data used to calculate 
interim rates, and establish a 
timetable to implement the 
recommendation in GAO’s 2002 
report to evaluate research and 
also to disseminate such research. 
Education agreed with GAO’s 
recommendations on accounting 
for different types of students and 
the need for research. On GAO’s 
other recommendation, Education 
noted steps it was taking to assess 
data reliability though it is unclear 
that such steps address data to be 
used for interim rates. 
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To view the full product, including the scope 
and methodology, click on the link above. 

For more information, contact Marnie S. 

Shaul at (202) 512-7215 or shaulm@gao.gov. 



What GAO Found 

As of July 2005, 12 states used a graduation rate definition — referred to as 
the cohort definition — that tracks students from when they enter high school 
to when they leave, and by school year 2007-08 a majority plan to use this 
definition. Thirty-two states used a definition based primarily on the number 
of dropouts over a 4-year period and graduates. The remaining states used 
other definitions. Because the cohort definition is more precise, most states 
not using it planned to do so when their data systems can track students 
over time, a capability many states do not have. Education has assisted 
states primarily on a case-by-case basis, but it has not provided guidance to 
all states on ways to account for selected students, such as for students with 
disabilities, thus creating less consistency among states in how graduation 
rates are calculated. 



States’ Planned Definitions by School Year 2007-08 




Source: GAO review of state accountability plans, NCES Report (NCES 2005-105), and Education's decision letters. 

The primary factor affecting the accuracy of graduation rates was student 
mobility. Students who come and go make it difficult to keep accurate 
records. Another factor was whether states verified student data, with fewer 
than half of the states conducting audits of data used to calculate graduation 
rates. Data inaccuracies can substantially raise or lower a school’s 
graduation rate. Education has taken steps to help states address data 
accuracy issues. However, Education officials said that they could not assess 
state systems until they had been in place for a while. Data accuracy is 
critical, particularly since Education is using state data to calculate 
graduation rate estimates to provide consistency across states. 

Many interventions are used to raise graduation rates, but few are rigorously 
evaluated. GAO identified five that had been rigorously evaluated and 
showed potential for improving graduation rates, such as Project GRAD. In 
visits to six states, GAO visited three schools that were using such 
interventions. Other schools GAO visited were using interventions 
considered by experts and officials to show promise and focused on issues 
such as self esteem and literacy at various grades. Education has not acted 
on GAO’s 2002 recommendation that it evaluate intervention research, a 
recommendation the agency agreed with, and has done little to disseminate 
such research. 
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September 20, 2005 

The Honorable Edward M. Kennedy 
Ranking Minority Member 
Committee on Health, Education, Labor, 
and Pensions 
United States Senate 

The Honorable Lamar Alexander 
Chairman 

Subcommittee on Education and Early Childhood Development 
Committee on Health, Education, Labor, 
and Pensions 
United States Senate 

The Honorable Jeff Bingaman 
United States Senate 

The Honorable Patty Murray 
United States Senate 

The Honorable Olympia J. Snowe 
United States Senate 

About one third of students who enter high school do not graduate and 
face limited job opportunities. The No Child Left Behind Act of 2001 
(NCLBA) was passed in part to increase the likelihood that all of the 48 
million students in our nation’s public school systems will graduate and 
requires states to use high school graduation rates, along with test scores, 
to assess how much progress high schools are making in educating their 
students. Graduation rates — used in conjunction with test scores — provide 
a more complete picture of school performance than test scores alone, 
because a school’s test proficiency rate will be higher if low-performing 
students drop out and do not have their scores included with their peers. 
Graduation rates are used as part of the determination about whether 
schools meet federal requirements for school progress. If schools do not 
meet such requirements, their students may be eligible to transfer to 
another school or receive tutoring. Currently, the Department of 
Education (Education), National Governors Association, and several 
national education organizations and foundations are working on high 
school reform initiatives to address issues, such as school structure and 
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curriculum, which may help low-performing students and increase the 
likelihood of graduation. In addition, our 2002 report on high school 
dropouts identified the need for better information on the success of 
interventions designed to increase the likelihood of students staying in 
school until they graduate. 1 

NCLBA defines graduation rates as the percentage of students who 
graduate from high school with a regular diploma in the standard number 
of years. Education’s regulations do not permit states to count an 
alternative degree that is not fully aligned with the state’s academic 
standards, such as a certificate of attendance or a General Educational 
Development certificate (GED). Each state has flexibility, however, in 
determining how its graduation rate will be specifically calculated as long 
as the rate is, as the law requires, “valid and reliable.” 

In response to congressional requests, we are providing information on: 

(1) the definitions states have developed for graduation rates and how 
Education supports states in meeting the law’s requirements for defining 
and measuring graduation rates; (2) the factors, such as student mobility, 
that affect the accuracy of the data used to calculate graduation rates for 
all students and those in designated groups, and what Education does to 
ensure accuracy of rates reported by states; and (3) what is known about 
the success of interventions with the potential to increase graduation rates 
and how Education has enhanced and disseminated knowledge about 
these practices. 

To address these objectives, we used a variety of methodological 
approaches. We analyzed the plans states were required to submit to 
Education to identify the graduation rate definitions states used and 
graduation rate goals set by states, reviewed updates to plans through July 
2005, and letters from Education to states regarding its decisions about 
state plans and updates. We also surveyed officials in 50 states, the District 
of Columbia, and Puerto Rico 2 to obtain information about the extent to 
which states verify school and district data used to calculate high school 
graduation rates and use unique student identifiers. We selected and 



hAO, School Dropouts: Education Could Play A Stronger Role in Identifying and 
Disseminating Promising Prevention Strategies. GAO-02-240 (Washington, D.C.: Feb. 1, 
2002 ). 

hereinafter, the term states will refer collectively to the 50 states plus the District of 
Columbia and Puerto Rico. 
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contacted 20 states for further analysis. States were selected to capture 
variation in high school graduation rate definitions, geographic location, 
and types of interventions with the potential to increase graduation rates. 
We conducted a case study in 1 state to calculate graduation rates; site 
visits in 3 states to review data accuracy; site visits in 6 states to observe 
interventions and interview staff at 16 schools; and phone interviews in all 
20 states to obtain information on definitions used, implementation status, 
and guidance provided. To identify which interventions have the potential 
to increase graduation rates, we reviewed the research on interventions 
and interviewed Education officials and dropout prevention experts. We 
also reviewed available evaluations of the types of interventions we 
observed to assess their findings and methodological approaches. To 
determine how Education assists states, we reviewed Education 
regulations, guidance, and other documents and interviewed Education 
and state agency officials. We also interviewed Education and state 
officials to determine the degree to which Education has enhanced and 
disseminated knowledge about interventions. To determine the extent to 
which reported dropout rates may be understated, we interviewed experts 
in this area and reviewed research on the topic. Finally, we interviewed 
officials from the National Governors Association, national education 
organizations, and other experts in the area of high school graduation 
rates and reviewed related research to obtain an understanding of the 
issues surrounding these rates and high school reform efforts to address 
them. For a more detailed explanation of our methodology, see appendix I. 
We conducted our work between September 2004 and July 2005 in 
accordance with generally accepted government auditing standards. 



Results in Brief 



A majority of states used or planned to use a graduation rate definition, 
referred to as the “cohort” definition, which follows a group of students 
over time from when they entered high school until they left. Education 
has assisted states; however, it has not provided guidance on ways to 
account for certain students. The cohort definition, used by 12 states as of 
spring 2005, compares the number of 12th grade graduates with the 
number of students enrolled as 9th graders 4 years earlier, while also 
taking into account the number of students who left the school, such as 
those who transferred in and out. Thirty-two states used a definition of 
high school graduation rate based primarily on the number of dropouts 
over a 4-year period and graduates, referred to as the “departure 
classification definition.” The remaining eight states used a variety of other 
definitions. Many states using the departure or other definitions are 
planning to move to the cohort definition by school year 2007-08 or when 
their data systems can accommodate its use. This definition may help 
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schools provide more precise graduation rates; however, it requires data 
systems that can track students or groups of students over time. Most 
states used these definitions to set graduation rate targets (for example, 80 
percent a year). Although states generally set numerical targets, many 
considered a school as meeting state graduation rate requirements if the 
school showed progress toward these targets. The progress states allowed 
generally ranged from any progress up to 1 percent, with two states 
allowing schools to maintain the graduation rate of the previous year. 
Education has supported states’ efforts to develop definitions that are 
intended to produce more precise results, developed some guidance, and 
provided support such as on-site peer reviews, conferences, and 
information on its Web site. Education also commissioned a task force 
that published a report identifying the advantages and disadvantages of 
different definitions. States also encountered challenges in resolving 
common issues, such as how to account for students with disabilities who 
graduate with a regular diploma in more than the standard number of 
years based on their Individualized Education Plans. Education has not 
provided guidance to all states on how to account for students in such 
programs; instead, Education’s approach has been to provide such 
information to states on a case-by-case basis. As a result, some states were 
not aware of the modifications available to count such students in their 
graduation calculation, and there is less consistency among states, even 
those using similar definitions, in how their rates are calculated. 

Difficulty tracking mobile student populations was the primary factor 
affecting the accuracy of graduation rates; while Education has taken 
some steps to help states address this challenge, concerns about data 
accuracy still exist. According to state, school district, and school officials 
and experts we interviewed, the more that a school’s students come and 
go, the more challenging it is for a school to maintain accurate records on 
whether students leave school by transferring or dropping out. Other 
factors — such as the degree to which states verify school and district 
data — also affect the accuracy of graduation rates. For example, fewer 
than half of the states reported conducting audits that verify these data. 
Data inaccuracies, such as miscounting the number of dropouts, can 
significantly raise or lower a school’s reported graduation rate. Because 
most states were in the process of adopting a different graduation rate 
definition, Education officials told us that they could not examine the 
reliability of the data used to calculate such rates until after the new 
definitions had been in place for multiple years. Such time would allow 
them to determine if the rates produced consistent results. Also, 

Education enhanced its state monitoring by adding a review component to 
examine data states used for graduation rates, among other aspects of 
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states’ participation in the Title I program. Furthermore, in response to 
recommendations from GAO and Education’s Inspector General, the 
agency contracted with a firm to develop a guide by the end of 2005 to 
help states improve data collection processes. In July 2005, Education 
announced that it planned to calculate and report interim graduation rate 
estimates for each state to provide a nationwide perspective. However, in 
our review we found that data problems exist, and it is unclear whether 
the department’s monitoring efforts are sufficient for states to provide 
accurate data for Education’s estimates. 

Few of the interventions that states and school districts have implemented 
to increase high school graduation rates have been rigorously evaluated, 
and Education has done little to evaluate and disseminate existing 
knowledge about effective interventions. We identified five interventions 
that had been rigorously evaluated and showed potential for improving 
graduation rates. In our visits to six states we visited three schools that 
were using such interventions. For example, Check and Connect, an 
intensive mentoring program, showed increased levels of educational 
attainment for students with emotional and behavioral disabilities. 

Another program, Project GRAD, a comprehensive kindergarten-to-12 
reform program, demonstrated some promise in improving test scores and 
graduation rates. In addition to the programs we visited, recently 
completed rigorous evaluations of two other programs, the Talent 
Development High School Model and First Things First, suggest that these 
interventions may also increase graduation rates. Most other programs we 
visited fell into one of three categories — restructuring schools, providing 
supplemental services, such as tutoring, and creating alternative learning 
environments — similar to findings in our 2002 report on high school 
dropouts. While these had not been rigorously evaluated, research and 
program officials noted some promising results that may lead to improving 
student outcomes including high school graduation. With the NCLBA 
requirement that interventions be research-based, there is a need in the 
education community for additional scientifically based research. 
However, Education’s efforts to evaluate and disseminate existing 
knowledge on interventions have been minimal. 

We are recommending that the Secretary of Education develop 
approaches to provide information on how to account for different types 
of students to all states rather than providing this information on a state- 
by-state basis and assess the reliability of data submitted by states that 
Education plans to use to develop interim graduation rates. We are also 
recommending that the Secretary establish a timetable to carry out the 
recommendation in our 2002 report regarding evaluating research on 
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dropout interventions, including those that focus on increasing graduation 
rates, and that the Secretary disseminate research on programs shown to 
be effective in increasing graduation rates. In comments on a draft of this 
report, Education concurred with our recommendations about accounting 
for different types of students and the need for evaluating and 
disseminating research on dropout interventions. On our recommendation 
to assess the reliability of data submitted by states, Education noted that it 
was taking steps to assess data reliability; however, it is not clear that 
these steps apply to data that Education plans to use to calculate interim 
rates. 



Background 



Despite the increasing importance of a high school education, only an 
estimated two thirds of students graduate from high schools nationwide. 
Students in certain subgroups, such as the economically disadvantaged 
and certain racial and ethnic groups, have historically graduated from high 
school at substantially lower rates than their peers. Students who do not 
graduate from high school are at a serious disadvantage compared to their 
peers who do. They are much less likely to obtain good jobs or attend 
college. The NCLBA includes several requirements for states to improve 
school and student performance, including measuring high school 
graduation rates. 



NCLBA Requirements NCLBA expanded the requirements of the Improving America’s Schools 

Act of 1994 (IASA) for states, school districts, and schools to demonstrate 
that their students are making adequate progress toward their state’s 
academic goals. IASA required testing in each of three grade spans to 
determine whether a school made adequate yearly progress (AYP). NCLBA 
requires, by the 2005-06 school year, that annual tests in math and reading 
be administered to students in grades 3 through 8 and once in high school; 
by 2007-08, students must also be tested in science. In order to make AYP, 
schools are to show that increasing numbers of students reach the 
proficient level on state tests and that every student is proficient by 2014. 
NCLBA also designated specific groups of students for particular focus. 
These four groups are students who (1) are economically disadvantaged, 
(2) represent major racial and ethnic groups, (3) have disabilities, and (4) 
are limited in English proficiency. 3 For a school to make AYP, its student 



3 Students with disabilities refers to students covered under the Individuals with Disabilities 
Education Improvement Act of 2004, the primary law that addresses the unique educational 
needs of children with disabilities. 
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body as a whole and each of the student groups must, at a minimum, meet 
the state targets for testing proficiency. 



Under NCLBA, schools must also use at least one other academic 
indicator, in addition to annual tests, to measure AYP. High schools must 
use graduation rate as one of their other academic indicators. The law 
defines graduation rate as the percentage of students who graduate from 
secondary school with a regular diploma in the standard number of years. 
Education officials told us that standard number of years is determined by 
a state and is generally based on the structure of the school. For example, 
a high school with grades 9 through 12 would have 4 as its standard 
number of years while a school with grades 10 through 12 would have 3 as 
its standard number of years. 

NCLBA regulations specifically require a high school, in order to make 
AYP, to meet or exceed its other academic indicators, including what the 
state has set as the graduation rate for public high schools. NCLBA does 
not specify a minimum graduation rate that states must set. States have 
used a variety of methods to measure AYP on their graduation rate 
indicator. For example, states have set graduation rate targets or goals or 
have allowed schools to show progress toward a target or goal as a way 
for schools to meet the graduation rate indicator requirement. The law 
does not require states to increase their graduation rate over time. 

The law requires states to demonstrate that their definitions produce 
graduation rates that are valid and reliable. A valid rate would be one that 
measures what it intends to measure. A reliable rate is one which, with 
repeated data collections and calculations, produces the same result each 
time such collections and calculations are performed. A key aspect of the 
reliability of graduation rates is the quality of the data used to calculate 
them. The National Center for Education Statistics (NCES), Education’s 
chief statistical agency, has funded a document that describes the 
following dimensions for ensuring that data are of high quality: 

• Accuracy. The information must be correct and complete. Data entry 
procedures must be reliable to ensure that a report will have the same 
information regardless of who fills it out. 

• Security. The confidentiality of student and staff records must be ensured 
and data must be safe. 

• Utility. The data must provide the right information to answer the 
question asked. 
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• Timeliness. Deadlines are discussed, and data are entered in a timely 
manner. 4 

This document suggests that school staff members are responsible for 
entering data accurately and completely and maintaining data security. It 
provides ideas for assisting staff to accomplish these tasks, such as 
sharing best practices with a peer and implementing school-district 
policies on data security, such as changing passwords frequently. 

If schools receiving funding under Title I, Part A of the act do not make 
AYP — including meeting the state’s requirements for graduation rates — for 
2 consecutive years or more, they are “identified for improvement.” They 
must take certain actions such as offering parents an opportunity to 
transfer students to a school that had made AYP (school choice). If these 
schools continue not to make AYP, they must take additional actions, such 
as providing supplemental services to students — including transportation, 
tutoring, and training. 5 States and school districts are required to provide 
funding for such actions up to a maximum specified in law. However, 
according to Education officials, most high schools do not receive Title I 
funding, and therefore, if these schools do not make AYP, they are not 
required to take improvement actions, such as offering school choice or 
supplemental services. However, NCLBA requires each school district 
receiving Title I funds to prepare a report card that must contain 
graduation rates for high school students and is available to the public. 



Education’s 

Responsibilities 



Education has responsibility for general oversight of Title I of NCLBA. As 
part of its oversight effort, Education has implemented the Student 
Achievement and School Accountability Program for monitoring each 
states’ administration of Title I programs. This monitoring effort was 
designed to provide regular and systematic reviews and evaluations of 
how states provide assistance in terms of funding, resources, and guidance 
to school districts to ensure that they administer and implement programs 
in accordance with the law. Monitoring is conducted on a 3-year cycle and 



4 U.S. Department of Education. National Forum on Education Statistics, Forum Guide to 
Building a Culture of Quality Data: A School and District. Resource, NFES 2005-801 
(Washington, D.C.: 2004). 

5 Schools designated as in need of improvement under the IASA had their designation carry 
over after NCLBA took effect. Also, schools receiving students through the school choice 
option must not be identified for improvement. 
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